The question of what the relevant entities or units of analysis for studying the dynamics of R&D are is central not only for adequate characterizations of the system of scientific and technological knowledge production but also for determining the correct focus for evaluation of R&D activities. Typically, R&D performance evaluations have focused not only on the wrong thing but have looked in the wrong place. Most evaluations have been project or program based. Often this focus is misleading. This article presents (...) a “knowledge value” framework as an alternative focus for understanding and evaluating scientific and technical work. This framework consists of two core concepts: the Knowledge Value Collective and the Knowledge Value Alliance. On the basis of the analysis of twenty-eight case studies of research activities, the authors present a typology of KVAs and conclude that they are a better object of evaluation than discipline-based projects. (shrink)

In recent times there has been a surge in interest on policy instruments to stimulate scientific and engineering research that is of greater consequence, advancing our knowledge in leaps rather than steps and is therefore more “creative” or, in the language of recent reports, “transformative.” Associated with the language of “transformative research” there appears to be much enthusiasm and conviction that the future of research is tied to it. However, there is very little clarity as to what exactly it is (...) and what criteria might be used to design policy instruments to make more of it happen. In this paper, we contribute to the construction of a framework within which some conceptual clarity might be gained. We develop four analogies, or metaphors, that are found in the discourse about “transformative research” and show what they imply for the meaning of the notion and, as a result, both the phenomena that might be associated with it and the levers that would be available to design policy instruments. The analogies serving as theoretical metaphors that we propose, and also document to be present either explicitly or implicitly in the discourse about “transformative research,” are the stock market highlighting risk; the process of evolution and its selection mechanisms; the process of popular culture and the power of “hot” events; and exploration of the frontier of the unknown. No single analogy covers all the relevant issues. Together they help identify a field of phenomena and the potential and challenges “transformative research” presents to policy. (shrink)